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ABSTRACT 




Computer simulation results are presc on the performance of convolu- 
tional codes of constraint lengths 7 and 10 concatenated with the (255, 223) 
Reed-Solomon code (a proposed NASA standard). These results indicate that as 
much as 0.8 dB can be gained by concatenating this Reed-Solomon code with a 
(10, 1/3) convolutional code, instead of the (7, 1/2) code currently used by 
the DSN. A mathematical model of Vlterbl decoder burst— error statistics is 
developed and is validated through additional computer simulations. 
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SECTION I 


INTRODUCTION 

The purpose of this report is to present new results on the combined per- 
formance of short constraint length Viterbi-decoded convolutional codes and 
Reed-Solomon codes. When one coding scheme is superimposed upon another, the 
resulting combination is called a concatenated code. Those interested in 
learning about these coding schemes can find elementary presentations in 
Reference 1-1. Our interest is in their performance. 

The DSN currently has both (7, 1/2) and (7, 1/3) Viterbi decoders. The 
performance of several convolutional codes of rates 1/2 and 1/3 with con- 
straint lengths between 7 and 10 have been known for some time (References 1-2 
and 1-3). At the time that the DSN Viterbi decoders were bull;, hardware 
speeds were not fast enough to build Viterbi decoders of constraint lengths 
beyond 7 that were sufficiently reliable and inexpensive. However, with 
current and expected technological advancements in mind, we have given another 
look at the possible performance of Viterbi decoders of constraint length 10 
and rates 1/2 and 1/3. 

This report not only extends previous Viterbi performance results, but 
also contains new performance results for convolutional codes concatenated 
with a (255, 223) Reed-Solomon code. (The performance of the DSN (7, 1/2) 
code concatenated with this Reed-Solomon code appears in Reference 1-4.) The 
Reed-Solomon bit-error probability depends not only on the (average) Viterbi 
bit-error rate, but also on the lengrhs of the Viterbi error bursts and the 
density of the errors within the bursts. Consequently, additional simulations 
are required to gather these statistics. 

The Galileo Project and the International Solar Polar Mission are plan- 
ning to employ a concatenated Reed-Solomon/Viterb i coding scheme for teleme- 
tering science and engineering data over the space communications channel. 

Even the V'oyager mission has this capability on board. Tlie reason for using a 
concatenated coding scheme over convolutional coding ahme is that concatenated 

coding makes more efficient use of signal power to achieve bit-error probabili- 
— 3 

ties in the 10 range. Such low error rates are necessary to make data com- 
pression schemes workabK-. Data compression algorithms, while promising to 
remove substantial information redund.im'y , are verv sensitive to trans- 
mission errors. In terms of cost vs benefits, a 0.8-dB (20’A) improvement 


1-1 


fro» coding is comparable co the increased performance of a 64-m and 14-m 
ra. ooer a ba-m antenna alone. Kooever. the cost of implementing soch a 

pair"!flr " alactronics to array such a 

pair of DSN antennas. 

Bin./ U Shown in rig„re 1-1 

iiZs r ' 
no ::::zzT2 z:::::::::: 

words ar. o, Reed-Solomon code- 

encodlr Z Ld l""' — l-tl.nal 

.To 1 7 “ Phase-modulated 

adio frpuency signal, which is amplified and sent out towards the Earth. 

mouulation stages are actually performed in the transmitter. The binary 
rst multiplied by a square-wave subcarrier, and then the resulting 
waveform a used to phase modulate a high-frequency sinusoidal carrie: 
n the ground, the analog signal is detected and tracked by the 
receiver, n carrier reference is derived and is used to heterodyne the signal 
su carr er frequency. The subcarrier demodulator assembly (SDA) removes 
square-wave subcarrier, and the symbol synchroniser assembly f gg 

r TleTTem- “ 

TT?:: 1”:: v:::::n ^ 

and decodes the convolutional I f Tlldr'" 

Mraav. el d v ^ Coding. The Reed-Solomon decoder 

then delnterleaves the symbols and does the final decoding. 

Pot the purpose of this report, only signal degradation caused by the 
auss an noise of the space channel is assumed. The comparisons madeh 
Sbou d remain valid when additional system degradations are included 7 
Slmu ations assumed that there are no losses from carrier and subcarrier 

ac .ng and dem.„,„,at ion , and chat the Viterbl decoder retains node synCro- 
-a .on at times, studies of these degradations are being undertaken 
nd the results will appear In future publications. 

















SECTION II 
SUMMARY 


Figure 2-1 Indicates the performances of several decoding schemes as a 

function of bit-energy-to-noise ratio. In particular, it shows the relative 

performances of several Viterbi-decoded convolutional codes Including the (7, 

1/2) code, which is the present standard for deep-space applications. Also 

shown in Figure 2-1 are Shannon’s theoretical performance limits for rate 1/2 

and rate 1/3 binary codes and the performance of uncoded transmission. The 

Shannon limits represent the best possible error performance for binary codes 

of these rates (Reference 2-1). It is easily seen that the (7, 1/2) code is 

-3 

2.3 dB away from the theoretical limit at an error probability of 5 x 10 . 

Also, the (10, 1/3) code is less than 2 dB from Shannon's limit for rate 1/3 
binary codes. 

Also shown in Figure 2-1 are the results of concatenating these convolu- 
tional codes with an outer Reed-Solomon (255, 223) code. Ideal interleaving 
is assumed as well as no system losses other than Gaussian channel noise. The 
performance of the concatenated scheme is very sensitive to signal-to-noise 
ratio (SNR); a 1-dB change can result in a bit-error probability jump of 
several orders of magnitude. Consequently, the use of such a concatenated 
scheme should be accompanied by tight control of the signal-to-nolse ratio of 
the communications link. Otherwise, the additional operating margin may 
negate the advantages derived from coding. 

In addition to these error performance curves, a mathematical model of 
the burst-error statistics of Viterbi decoding is developed in this report. 

The model generates errors similar to those of Viterbi decoders by using a 
simple "Monte Carlo" technique. All that is needed to apply the model are 
three parameters that depend on the particular code and channel SNR. These 
parameters are tabulated in this report (see Appendix C) for several different 
convolutional codes and channel SNRs. The error sequences generated by this 
model are shown to behave similarly to actual error sequences when both are 
used to generate Reed-Solomon performance curves. The advantage of the model 
is that it may be used to generate Viterbi error sequences quickly and Inex- 
pensively for use in simulations when a very large amount of data is needed. 
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Figure 2-1. Comparison of Several Coding Scheme 



SECTION III 

SIMULATED PERFORMANCE OF SEVERAL CODING SCHEMES 

The key to cooputlng the perfomence of the coecetenated coding eyeteh le 
detemlnlng the Reed-Solo«on sj«bol-error statistics. This Information cannot 
be deduced from Vlterbl bit-error performance curves. Consequently, extensive 
simulations were performed on the Xerox Data Systems Sigma 5 computer to cal- 
culate both Che Vlterbl bit-error and Reed-Solomon symbol-error statistics. 
Each data point mas generated by processing 900,000 bits through a modifica- 
tion of the software Vlterbl decoder developed by J.W. Layland. The simula- 
tions assumed that there were no system losses due to receiver noise or lack 
of synchronization. The only degradation present In the simulation was that 
of the random number generator simulating additive white Gaussian noise to 
reflect the channel SNR. Also, sufficient Reed-Solomon symbol interleaving 
was assumed so that the symbol-error events were Independent. This Is 
referred to as Ideal Interleaving. It Is worth noting that Interleaving to a 

dec 5 Is nearly Ideal for the DSN (7, 1/2) Inner convolutional code at 

SNk ove 2.0 dB. 

Figure 3-1 shows the results of these simulations. In addition to the 
plots of Viterbi bit-error probability, p, as a function of channel SNR, 
tb/No), each part of Figure 3 displays the Reed-Solomon symbol-error 
probability, The Reed-Solomon bit and word-error probabilities are calcu- 

ated from ,r and other burst statistic Information derived from these simula- 
tions. These calculations and the theory behind them are described in detail 
In gippendlx A. The Reed-Solomon performance curves are plotted against a 
concatenated channel SNR. which Is 0.58 dB greater than that of the Vlterbl 
channel due to the overhead of the Reed-Solomon parity symbols. 
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-1, Performance Statistics for Ideally Interleaved Concatenated Coding 
Scheme (Assuming No System bosses) : (a) 3233013 (7, 1/2) Convolu- 
tional Code and (255, 223) Reed- Solomon Code; (b) 7376147 (7, 1/3) 
Convolutional Code and (255, 223) Reed— Solomon Code; (c) 3103320323 
(10, 1/2) Convolutional Code and (255, 223) Reed-Solomon Code- 
(d) 7461776427 (10, 1/3) Convolution Code and (255, 223) Reed- 
Solomon Code 
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PROBABILITY OF ERROR 






Figare 3-1 (contd) 


3-4 

> , 




I 



PROBABILITY OF ERROR 



CONCATENATED 
REED-SOLOMON 
WORD ERROR 
PROBABILITY 
(COMPUTED) 


REED-SOLOMON 
SYMBOL ERROR 
PROBABILITY (tt) 


CONCATENATED 
REED-SOLOMON 
BIT ERROR 
PROBABILITY 
(COMPUTED) — ^ 


VITERBt DECODER 
BIT ERROR 
PROBABILITY 
(SIMULATED) 



Ej^/Nq, dB 


Figure 3-1 (contd) 



SECTION IV 

A GEOMETRIC MODEL OF VITERBI BURST-ERROR STATISTICS 


The software simulations described in Section III produced a large amount 
of Viterbi decoder burst-error statistics, which were then studied* It was 
found that Viterbi decoder error bursts, as well as waiting times between 
bursts, were very nearly geometrically distributed. 

Three parameters are needed to define these distributions. They are the 
average burst length, B, the average waiting time, W, and the average density 
of errors in a burst, 0. Given these parameters, Viterbi decoder burst 
lengths, B, were observed to be distributed according to 

pr(B = m) = p(l - p)“ ^ (m > 0) 

where 

p = 1/B. 

Errors within bursts occur randomly with probability 0. Waiting times, W, were 
observed to be distributed according to 

pr(W = n) = q( 1 - q)" (n > K - 1) 

where K is the constraint length of the code and 

q = 1/(W - K + 2). 

Derivations of these formulae may be found in Appendix B. 

A Monte Carlo software routine was written to generate Viterbi error 

sequences directly from these formulae. The advantage of doing this is that 

K-7 

the Viterbi software decoder requires about 2 hours per million bits of 
computer time (XDS Slgma-5 computer), while the geometric model requires an 
average of five minutes per billion bits. 
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To validate the geometric model, Reed-Solomon word- and bit-error rates 
were calculated using both the Viterbi software decoder and the geometric model 
routine. No interleaving was used so that the effects of the error bursts 
appeared to the maximum extent possible. These results were compared and 
are shown for various codes in Figure 4-1. (Some of the curves exhibited in 
this figure run off the edge of the page since the next data point was too 
low to be plotted on the same scale.) It is easily seen that the geometric 
model closely approximates the actual data in all cases. 
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Figure 4-1. Nonlnter leaved Performance Stati.stics for Concatenated Coding Scheme 
(Assuming no System Losses) : (a) 3233013 (7, 1/2) Convolutional 
Code and (255, 223) Reed-Solomon Code: (b) 7376147 (7, 1/3) Convo- 
lutional Code and (255, 223) Reed-Solomon Code; (c) 31311223 (8, 1/2) 
Convolutional Code and (255, 223) Reed-Solomon Code.; (d) 313321013 
(9, 1/2) Convolutional Code and (255, 223) Reed-Solomon Code; 

(e) 3103320323 (10, 1/2) Convolutional Code and (255, 223) Reed- 
Solomon Code: (f) 7461776427 (10, 1/3) Convolutional Code and 
(255, 223) Reed-Solomon Code 
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SECTION V 

CONCLUSION AND DISCUSSION 

The software modsl of the Vlterbi decoder used In this study can be 
enhanced by the Inclusion of some of the system losses that arise in actual 
hardware devices. By adding these degradations to the model, their effects 
can be studied and possible remedies can be Incorporated into future system 
designs. 

The Vlterbi decoders currently used by the DSN suffer loss of node 
synchronization at low SNRs. This means that if the signal is too weak, the 
decoder cannot decide which of the two code symbols associated with each data 
bit should be first. The concatenated coding system described In this report 
allows transmission of data at SNRs lower than those required for a convolu- 
tional-only scheme. This means that node synchronization losses will be 
higher in the concatenated scheme. 

Synchronization problems are also associated with the Reed-Solomon code. 

A method for determining Reed-Solomon symbol and word boundaries Is needed. 

If a packet telemetry system such as the one proposed by the End-to^End Infor«- 
matlon System (EEIS) (Reference 5-1) is to be implemented, then a frame 
synchronization device is also required. 

For this report, only the error correcting capability of the Reed-Solomon 
code was considered. However, this code is also capable of correcting a 

number of erasures, l.e., Reed-Solomon symbols that are suspected to be in 5 

error. The (255, 223) code can correct E errors and e erasures in each code- ^ 

word as long as 2E + e < 33. If erasures can be detected, then the perform- ^ 

ance of the concatenated codes may Improve by as much as 0.3 dB. ] 

It should be noted that the loss of node synchronization and subsequent I 

recovery by the Vlterbi decoder may cause a deletion or Insertion of a bit ) 

Into the data stream entering the Reed-Solomon decoder. When this occurs, 

Reed-Solomon symbol and word synch will be lost. In the proposed EEIS packet 

telemetry scheme, a node synch failure could result In a loss of over 8000 4 

information bits. Consequently, the sensitivity of the concatenated coding 

■j 

to node synchronization losses Is potentially greater than that of convolu- 
tional coding alone* 

s 

•4 

I 
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The effects of carrier, subcarrier, symbol, and bit tracking In the sys- 
tem are also Important to the overall performance of the coded channel since 
poor carrier tracking Increases the number of Vlterbl decoder bit errors. 

The strict error-rate requirements of data compression are a major reason 
for investigating concatenated coding schemes. These requirements stem from 
the removal of redundant Information, hence compression. As an example, one 
data compression scheme (Reference 5-2), reduces the number of bits per 
picture by over one half without loss of Information. The reconstructed 
compressed data, however, are more sensitive to transmission errors than the 
drlglnal data. Hence, error correcting codes must be used. Notice that the 
concatenated schemes described In this report more than double the number of 
bits that are transmitted per Information bit. This seems to neutralize the 
useful effects of data compression. Actually, this Is not the case since an 
SNR of 9.5 dB would be required If no coding were employed to achieve an error 
rate of 10 (see Figure 2-1), whereas the concatenated scheme with the (7, 
1/2) Inner code requires only 2.3 dB, and only 1.6 dB is required when the 
(10, 1/3) inner code is used. It might be beneficial to consolidate c'ata 
compression and channel coding Into a one-step process. 
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EXPLANATION OF SIMULATIONS AND CALCULATIONS 

It is well known that the bit errors produced by Vlterbl decoding in the 
presence of noise are not independent. Instead » they tend to group together 
in error clumps known as "bursts.” This happens because error evants in a 
Viterbi decoder are caused by excursions from the correct path in the code 
trellis structure (Reference 1-1). The calculation required to generate the 
performance curves of Section III required a careful tabulation of these error 
bursts for the various convolutional codes under consideration. The theory 
behind these calculations is outlined in this section. 

A. THE DEFINITION OF "BURST" 

Denote the constraint length of the convolutional code under considera- 
tion by K. Consider a sequence of bits output by the Viterbi decoder of the 
form 

K - 1 B K - 1 

ccc • • c e XXX ■ • X e ccc* «c 

where the letter c represents a correctly decoded bit, an e represents a bit 
error, and an x may be either correct or in error. Suppose also that there is 
no string of K - 1 consecutive c’s in the sequence xxx- -x. Then the string 
exxx . xe is called a "burst" of length B, The motivation behind this defini- 
tion of a burst is that a string of K - 1 consecutive correct bits will return 
the Viterbi decoder to the correct decoding path. A string of c*s between two 
bursts will be referred to as a "waiting time." 

B. THE CALCUI.ATIOM OF p and " 

The calculation of the Viterbi bit-error rate, p, by the Viterbi software 
decoder amounts to simply counting the number of bit errors made and dividing 
by the total number of bits examined. The calculation of the Reed-Solomon 
input symbol error probability, r, is more Involved and is described below. 
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The Reed-Solomon code considered in this report has code words consisting 

of 255 eight-bit Reed-Solomon symbols. The quantity ir is therefore the 

probability that a set of eight consecutive Vlterbl-decoded bits contains at 

least one error. If Vlterbl bit errors were Independent, one would expect 

^ “ 1 - (1 - p) . However. Vlterbi bit errors are certainly not Independent 

and. in fact, this estimate for tr is more than double the correct value for 
small p. 

One way to obtain a good estimate for jr is to partition the output bit 
stream of the Vlterbi decoder into disjoint sets of eight consecutive bits and 
observe how many of these sets contain bit errors. However, since no a priori 
knowledge of symbol synchronization is assumed in these simulations, it is 
better to average over all sets of eight consecutive bits. This amounts to 
sliding a window of size eight over the output of the Vlterbi decoder. The 
actual algorithm used in the simulations is as follows. 

Suppose n bits are decoded by the Vlterbi decoder. Then the number of 
symbol errors should be nx/8. On the other hand, a burst of length B will 
corrupt, on the average. (B + 7)/8 symbols. Since waiting times are of length 
at least K - 1, and K > 7 for this report, it is extremely rare for two 
bursts to corrupt the same symbol. If there were N bursts of length 
Bj (1 < 1 < N), then 


number of symbol errors 




B, + 7 


f 


where ff is the average burst length. It follows that 


N(B + 7) 


(A-1) 


If e IS defined as the average density of errors in a burst, then Equation 
(A-i) may be rewritten in the form 


A-2 





The quantities n, N, p, and 6 are easily tabulated by the software Viterbl 

decoder . 

C. ESTIMATION OF UNCERTAINTY IN THE CALCULATIONS 

Since only a finite number of bits may be examined in any simulation. It 
Is advantageous to have a measure of how well the estimates of p and ir 
described above reflect their actual values. Again let N be the number of 
bursts observed. Let be the number of bit errors in the 1^^ burst 
(1 < 1 < N). Assume that the X^'s are independent and Identically dis- 
tributed (l.l.d.) with first and second moments E(X) and E(X^) respec- 
tively. Assume also that N is Poisson distributed with mean X and that N Is 
independent of each X^. The the number of bit errors observed Is 

N 

* 1 ' 

1=1 

In Reference A-1 it Is shown that 

E(Sjj) = E(N)E(X) 

and 

Var(S^) = E(N)Var(X) + (E(X))^Var(N) . 

Since N is Poisson, E(N) - Var(N) - X . Let 0 • (Sj,)/E(Sjj) be the 
fractional uncertainty in the measurement of S^. Then the quantities E(X), 

E(X ), and X are estimated by the software Viterbl decoder to give an 
estimate of 0, 

To estimate the uncertainty In the calculation of n, let B be the 
length of the 1 burst and let T^^, be the number of symbol errors 
occurring In N bursts. From Equation (A-1) It follows that 


I 





N 

H <-‘i* 

i»l 

so that 


E(T^) 


\( 


7 + E(B) 
8 


) 


and 


Var(Tjj) = ^ (49 + 14E(B) + E(B^)). 

If 7 = a (Tjj)/E(Tjj) is the fractional uncertainty in the calculation of 
If , then 


1 I 49 + 14E(b; + E(B^) . 

^ “ 7 + E(B) ->/ X 

As before, E(B) and E(B^) are easily tabulated by the software Viterbi decoder. 

Figure A-1 shows plots of p and tt (the same as those in Figure 3-1) 
with error bars representing the uncertainty in their calculation included. 


D. REED-SOLOMON WORD ERROR PROBABILITY, 

To calculate the Reed-Solomon word-error probability, sufficient symbol 
interleaving is assumed so that the symbol errors may be considered to be 
Independent. Since a word error occurs exactly when there are 17 or more 
symbol errors in a 255-symbol word, 


**word 


255 


^ (1 - ir ) 

J-17 


255-J 
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Figure A-l . Performance Statistics of Viterbl Decoder (Assuming No System 
Losses): (a) 3233013 (7, 1/2) Convolutional Code; (b) 7376147 
(7, 1/3) Convolutional Code; (c) 3103320323 (10, 1/2) Convolu- 
tional Code; (d) 7461776427 (10, 1/3) Convolutional Code 
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E. REED-SOLOMON BIT-ERROR PROBABILITY, p 

_ bit 

Let B and 6 be the average burst length and the average density of 
errors In a burst, respectively, for the convolutional inner code in 
question. If a Reed-Solomon word error occurs, then between 17 and 255 
symbols are in error. Recall that the average number of symbols corrupted by 
a burst is (B + 7)/8. Hence the bit-error probability in a corrupted symbol 
is 8B/(B +7). If follows that 

255 

Pbit “ Xj 
j-17 


i 


i 




I 

i 
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APPENDIX B 


DERIVATION OF THE GEOMETRIC MODEL OF BURST STATISTICS 

A random variable X Is said to be geometrically distributed with 
parameter pe[0, 1] if 


pr(X - s) - p(l - p)® (8 . 0, 1, 2, •••). 

For the purposes of this section, a random variable Y satisfies a 'modified 
geometric distribution" of parameter p€[0, 1] if there exists a positive 
Integer d such that 


pr(Y • s) « p(l - p)* 


(s - d, d + 1 , d + 2 , ...) 


In this case, Y will be called d-geometrlcally distributed. 

In Reference B-1, J. Omura showed by a random coding argument that burst 
lengths for an "average convolutional code" have a distribution that may be 
overbounded by a 1-geometrlc distribution. In this report. It will be shown, 
in fact, that for convolutional codes of constraint lengths seven through ten, 
burst lengths are very nearly 1-geometrlcally distributed. Moreover, the 
waiting times are K - 1 geometrically distributed. 

The teste thst were used to exhibit these facts were esseotlsll, the sswe 
for burst lengths sod waiting tlMs. For this reason, only the test for burst 
lengths will be described below. 

Suppose that a Vlterbl decoder simulation is performed and N bursts are 
observed. Let B^ be the length of the l'^ burst (1 - 1, 2, 3, • • , N) . 

Let B be the random variable representing burst length (so B is the l^*’ 
sample of the random variable B). It must be shown that ^ 


pr(Bj - s) - p(l - p)' 


(« - 1, 2, 3, ) 


(B-1) 


some pc[0, ,IJ. The fact that these probabilities must sum to one forces 
p " 1/B. 

For each m ■ 1, 2, 3, • , let N^ be the number of bursts of length 

greater than or equal to m. If the burst lengths were indeed 1-geometrlcally 
distributed with parameter 1/B, then the expected value of N /N would be 
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In other words, for N sufficiently large. 


1 - 1/5 - (,- 2 ) 

which is a constant. 

Since N is only moderately large in the simulations described in Section 
III (on the order of 200 to 500), the performance of this test can be Improved 
by grouping bursts of several consecutive lengths into bins. Enough bursts 
were placed into each bin so that 1 - 1/B could be approximated to within 0.05 
with 90% accuracy for each Mn. These approximations remained reasonably 
constant between bins. Indicating a successful test. 

As remarked In Section IV, waiting times were found, by a similar test, 
to be K - 1 geometrically distributed with parameter q - 1/(W - K + 1), where W 
is the average waiting time and K Is the constraint length of the code. 

The geometric model of Vlterbl burst-error statistics states that these 
bursts occur randomly according to these two modified geometric distribu- 
tions. Errors within a burst occur essentially randomly (except for the fact 
that each burst starts and ends with an error) with probability 0 » To gener- 
ate error sequences similar to those produced by a Vlterbl decoder, only the 
quantities ff, 5, and 9 must be kncvn. These are tabulated for several codes 
and channel SNRs in Appendix C. 
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APPENDIX C 

TABLES OF VITERBI DECODER BURST STATISTICS 
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The following tables give values of some Important parameters describing 
the burst statistics of Vlterbi decoding* These are the average burst length, 
B, the average waiting time, W, and the average density of errors In a burst, 

6 • The tables show the values of these parameters for the DSN (7, 1/2) con- 
volutional code as well as for (7, 1/3), (10, 1/2), and (10, 1/3) codes. A 
range of channel SNRs that Is of Interest In deep— space applications Is 
considered. 
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Table C-1. Viterbi Decoder Burst Table C-2. Viterbi Decoder Burst 

Statistics: 3233013 Statistics: 7376147 

(7, 1/2) Convolutional (7, 1/3) Convolutional 
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